Per-Layer Embeddings